Method and Apparatus for Displaying Information During an Instant Messaging Session

ABSTRACT

A method and an apparatus are provided for controlling a graphical user interface to display information related to a communication session. Information relating to data produced by a first participant to the communication session is displayed on a first display unit, wherein the information produced by the first participant is displayed at a first position on the first display unit. Data is received from a second participant to the communication session, and information relating to the data received from the second participant is displayed on the first display unit, wherein the information received from the second participant is displayed at a second position on the first display unit. The first and second positions are horizontally spaced apart.

CROSS-REFERENCE TO RELATED APPLICATION

This application is a continuation of U.S. patent application Ser. No.15/714,783, titled “METHOD AND APPARATUS FOR DISPLAYING INFORMATIONDURING AN INSTANT MESSAGING SESSION,” filed Sep. 25, 2017, which is acontinuation of U.S. patent application Ser. No. 13/908,998, titled“METHOD AND APPARATUS FOR DISPLAYING INFORMATION DURING AN INSTANTMESSAGING SESSION,” filed Jun. 3, 2013, which is a continuation of U.S.patent application Ser. No. 11/688,664, titled “METHOD AND APPARATUS FORDISPLAYING INFORMATION DURING AN INSTANT MESSAGING SESSION,” filed Mar.20, 2007, which is a divisional of U.S. patent application Ser. No.10/428,523, titled “METHOD AND APPARATUS FOR DISPLAYING INFORMATIONDURING AN INSTANT MESSAGING SESSION,” filed May 2, 2003. All of theseapplications are incorporated by reference herein in their entirety.

BACKGROUND OF THE INVENTION 1. Field of the Invention

This invention relates generally to a user interface for displaying anexchange of messages during an instant messaging session, and, moreparticularly, to a method and apparatus for displaying instant messageexchanges in a manner that graphically differentiates the participantsin a conversation.

2. Description of the Related Art

Networks, such as the Internet, intranets, or other private or publicnetworks, are ubiquitous. In fact, many computers are connected to oneor more networks at the same time. For example, a business may havehundreds or even thousands of computers coupled to its own privatenetwork, which was, at least initially, used primarily for storage andexchange of computer files. At least some of these same businesscomputers may also be coupled to the internet. Further, with thedevelopment of wireless devices, ad hoc networks may also be formed withproperly configured portable devices. Even telephonic devices, such ascellular phones, pagers and the like, may be coupled to one or more ofthese networks. Small businesses and homes are also often connected insimilar arrangements.

All of this connectivity has naturally led to communications betweenvarious users over these networks. For example, electronic mail(e-mail), because of its usefulness, is now commonplace. E-mail is nowwidely used by businesses and individuals, and in at least someinstances has replaced more traditional forms of communications, such asmailed letters, facsimiles, telexes, and the like. However, e-mail hasproven to be somewhat awkward when used to carry on an ongoingconversation.

Instant messaging, on the other hand, allows two or more users connectedthrough these networks to carry on an interactive conversation.Exemplary instant messaging systems include Apple iChat, AOL InstantMessenger, Microsoft MSN Messenger, and the like. Typically, two or moreusers type in messages or select icons, which they send to one another.The receiving party(ies) may immediately respond with an appropriatemessage or icon. These instant messages are commonly all displayed inserial fashion, such as shown in FIG. 1, usually scrolling the user'sscreen from top to bottom. Commonly, each message is preceded by alabel, such as BobbyD211 and Fred1432 in FIG. 1, indicating the identityof the author of the message. Heretofore, users have relied on theselabels, or other limited indicia, to locate and identify messages from aparticular party. Accordingly, it will be appreciated that thepresentation of each message in substantially similar format makes itdifficult to readily determine the authorship of one or more previousmessages. Likewise, it is difficult to go back and quickly locate aprevious message without reading through many previous messages.

The present invention is directed to overcoming or at least reducing oneor more of the problems set forth above.

SUMMARY OF THE INVENTION

In one aspect of the present invention, a method is provided fordisplaying information related to a communication session. Informationrelating to data produced by a first participant to the communicationsession is displayed on a first display unit, wherein the informationproduced by the first participant is displayed at a first position onthe first display unit. Data is received from a second participant tothe communication session, and information relating to the data receivedfrom the second participant is displayed on the first display unit,wherein the information received from the second participant isdisplayed at a second position on the first display unit. The first andsecond positions are spatially distinct.

In another aspect of the present invention, a computer readable programstorage device is provided and encoded with instructions that, whenexecuted by a computer, performs a method. The method includesdisplaying information relating to data produced by a first participantto the communication session on a first display unit, wherein theinformation produced by the first participant is displayed at a firstposition on the first display unit. Data is received from a secondparticipant to the communication session, and information relating tothe data received from the second participant is displayed on the firstdisplay unit, wherein the information received from the secondparticipant is displayed at a second position on the first display unit.The first and second positions are spatially distinct.

In still another aspect of the present invention, a graphical userinterface for displaying information related to a communication sessionis provided. The interface is comprised of a first and a secondspatially distinct region. The first region is adapted to display atleast one message from a first participant to the instant messagingsession. The second region is adapted to display at least one messagefrom a second participant to the instant messaging session, and thefirst and second spatially distinct regions partially overlap and eachinclude at least a portion that is free from overlapping.

In yet another aspect of the present invention, a method for displayinginformation related to a communication session is provided. Informationrelating to data produced by a participant to the communication sessionis received. The information received from the participant is then atleast partially displayed within a speech balloon.

In still another aspect of the present invention, a graphical userinterface for displaying information related to a communication sessionis provided. The graphical user interface comprises a first and secondregion, wherein the first region is adapted to display a speech balloon.The second region is adapted to display at least one message from aparticipant to the instant messaging session, wherein the second regionis at least partially located within the first region.

BRIEF DESCRIPTION OF THE DRAWINGS

The invention may be understood by reference to the followingdescription taken in conjunction with the accompanying drawings, inwhich like reference numerals identify like elements, and in which:

FIG. 1 illustrates a view of a screen representative of a graphical userinterface of a prior art instant messaging system;

FIG. 2 illustrates a top-level diagram of one embodiment of a hardwaresystem on which the present invention may be implemented;

FIG. 3 illustrates a flowchart of an embodiment of a graphical userinterface that may be executed by components within the system of FIG. 1to produce the exemplary screens of FIGS. 4 and 5;

FIG. 4 illustrates a first view of an exemplary screen representative ofa graphical user interface;

FIGS. 5A-5B illustrate a second and third view of exemplary screensrepresentative of a graphical user interface;

FIG. 6 illustrates a flowchart of an alternative embodiment of agraphical user interface that may be executed by components within thesystem of FIG. 1;

FIG. 7 illustrates a view of an exemplary screen representative of agraphical user interface;

FIG. 8 illustrates an alternative view of the exemplary screen of FIG.7;

FIGS. 9A-9B illustrate speech bubbles; and

FIGS. 10A-10B illustrate speech balloons.

While the invention is susceptible to various modifications andalternative forms, specific embodiments thereof have been shown by wayof example in the drawings and are herein described in detail. It shouldbe understood, however, that the description herein of specificembodiments is not intended to limit the invention to the particularforms disclosed, but on the contrary, the intention is to cover allmodifications, equivalents, and alternatives falling within the spiritand scope of the invention as defined by the appended claims.

DETAILED DESCRIPTION OF SPECIFIC EMBODIMENTS

Illustrative embodiments of the invention are described below. In theinterest of clarity, not all features of an actual implementation aredescribed in this specification. It will of course be appreciated thatin the development of any such actual embodiment, numerousimplementation-specific decisions must be made to achieve thedevelopers' specific goals, such as compliance with system-related andbusiness-related constraints, which will vary from one implementation toanother. Moreover, it will be appreciated that such a development effortmight be complex and time-consuming, but would nevertheless be a routineundertaking for those of ordinary skill in the art having the benefit ofthis disclosure.

Turning now to FIG. 2, a block diagram depicting a system 100 inaccordance with embodiments of the present invention is illustrated. Thesystem 100 includes a plurality of computing devices coupled togetherthrough one or more network connections. For example, a plurality ofdevices may be coupled together via a private or public network, such asa local area network (LAN) 102 or the Internet. The actual connectionbetween the devices and the LAN 102 may take on one or more of any of avariety of forms, such as a network interface card (NIC), a modem, adigital subscriber line (DSL), a cable modem, a wireless connection, andthe like. The devices coupled to the LAN 102 may include, for example,desktop computers, such as an Apple Macintosh® 104, a classic Apple Mac®106, an IBM compatible personal computer (PC) 108, and the like.Further, these desktop computers, such as the Apple Macintosh® 104, maybe coupled together via a smaller sub-LAN 110, with the sub-LAN 110being coupled to the LAN 102. Portable devices, such as the ApplePowerBook® or iBook® 112, may also be coupled to the LAN 102, eitherdirectly or as part of the sub-LAN 110. Further, other consumer devices,such as cell phones, personal data assistants (PDAs), networkappliances, and other embedded devices may be connected to the LAN 102so as to employ aspects of the instant invention.

While the invention has been illustrated herein as being useful in anetwork environment, it also has application in other connectedenvironments. For example, two or more of the devices described abovemay be coupled together via device-to-device connections, such as byhard cabling, radio frequency signals (e.g., 802.11(a), 802.11(b),802.11(g), Bluetooth, or the like), infrared coupling, telephone linesand modems, or the like. The instant invention may have application inany environment where two or more users are interconnected and capableof communicating with one another.

Those skilled in the art will appreciate that network connections mayinclude a variety of other equipment, such as routers, switches,telephone modems, wireless devices, cable modems, digital subscriberlines, and the like. This type of equipment is not illustrated ordiscussed in detail herein so as to avoid unnecessarily obfuscating theinstant invention. For purposes of understanding the instant invention,it is sufficient to recognize that additional conventional equipment ofthis type may be useful in establishing and maintaining communicationsbetween the various users.

At least two of the devices in the system 100 have software, such as anapplication program, installed thereon to allow an instant messagingsession to be initiated and conducted. An instant messaging session mayinclude real-time or near real-time communications. FIG. 3 illustrates aflowchart of a portion of the software associated with initiating theinstant messaging session and controlling a graphical user interface(GUI) used by the participants to the instant messaging session. Inparticular, the process begins at block 300 in a conventional mannerwith one of the two parties sending the other party an invitation toinitiate an instant messaging session. Assuming that the other partyaccepts the invitation, the software on each party's computer initiatesthe GUI, which opens a window where both parties' messages and otherpertinent information and controls are displayed. An exemplaryrepresentation of the GUI is shown in FIG. 4 and may be referencedsimultaneous with the discussion of FIG. 3 herein for a more completeunderstanding of the operation of the instant invention.

The messages exchanged by the participants may contain informationregarding an icon to be used to represent each party. For example, partyA may select an icon, such as “Mary” 400 as a graphical representationof party A. Party B may receive and store the icon and then display itadjacent a message delivered by party A. The icon makes it easier forparty B to more quickly identify those messages associated with party A.An exemplary exchange of messages in which party A has selected the icon“Mary” 400 and party B has selected the icon “Sue” 402 is shown in FIG.4. Displaying unique graphical icons allows a user to readily identifythe speaker with a quick glance. Additionally, displaying the iconsadjacent each party's message allows the users to identify the speakerwithout looking away from the message region of the GUI. In analternative embodiment, the user may elect to display not only the icon,but also the name associated with the author of the message. On theother hand, the user may elect to display only the name associated withthe author of the message, preventing the icon from being displayedaltogether, if desired.

Those skilled in the art will appreciate that the icons need not bedelivered with each message. That is, party A may send an icon duringthe initial portion of the session, and party B will associate the iconwith party A, store it locally, and then retrieve and display it eachtime a message is received from party A. Additionally, party A's iconmay be overridden locally by party B. That is, party B may elect todisplay a different icon adjacent party A's messages, at least on theGUI viewed by party B. Party B may select any of a plurality of iconsstored locally, and indicate through the local GUI, such as by pointingand clicking on various pull-down menus provided by the local GUI, thatthe selected icon should be used when displaying party A's messages.

The GUI may also use additional strategies to graphically differentiatethe parties of the instant messaging session. For example, a sendingparty may send an indication of a color scheme in which his/her messagesshould be displayed. The receiving party may then, at his/herdiscretion, display the messages from the sender in the requested colorscheme.

Alternatively, the receiving party may elect to override the sendingparties requested preference, and instead display each party's messagein its own distinct color. That is, party A, during an initializationphase, may indicate through the local GUI that any message received fromparty B should be displayed with red letters and a white background, andthat any messages generated by himself, should be displayed with ayellow background and black letters. In either case, the colordistinction allows the party to visually determine the author of amessage without the need to read and understand an identifying name,such as is illustrated in the prior art at FIG. 1 (e.g., BobbyD211).

Allowing the sender to select the color and style, however, may lead tosome confusion in the event that another participant to the instantmessaging sessions elects a similar style and/or font. Empowering thereceiver of the message to override locally the style and color choicesindicated by the sender may help to alleviate any confusion. That is,the receiving party may elect to display the message with a differentcolor and style than indicated by the sending party, at least on the GUIviewed by the receiving party. The receiving party may select any of aplurality of colors and styles stored locally, and indicate through thelocal GUI, such as by pointing and clicking on various pull-down menusprovided by the local GUI, that the selected color and style should beused when displaying the received messages. Alternatively, the GUI maybe programmed to automatically assign a different color to eachparticipant.

An additional graphical distinction may be accomplished by partitioningthe GUI into spatially distinct regions and then directing the messagesto a region based upon its authorship. For example, the exemplary GUI ofFIG. 4 has been generally divided into two horizontal regions, a leftregion 404 and a right region 406. For example, all messages generatedby the local user (party A), represented by Mary 400, are displayed inthe right region 406, and all messages generated by the remote user(party B), represented by Sue 402, are displayed in the left region 404.It should be appreciated that the assignment of left and right regionsto parties A and B, respectively, may be reversed without departing fromthe spirit and scope of the instant invention. Moreover, it isanticipated that the various spatially distinct regions may overlap.That is, a message generated by Mary 400 may extend from the rightregion 406 and at least partially into the left region 404. Similarly, amessage generated by Sue 402 may extend from the left region 404 and atleast partially into the right region 406. Thus, the messages may atleast partially overlap, depending on the length of the messages.

Further, depending upon the number of participants, it may be useful todefine more than two spatially distinct regions. For example, wherethree participants are present, it may be useful to provide threehorizontal regions.

In the exemplary GUI of FIG. 4, the text of the messages associated withSue 402 is displayed in the left region and is left justified. Similarlythe text of the messages associated with Mary 400 is displayed in theright region and is right justified. Those skilled in the art willappreciate that other justification schemes may be used withoutdeparting from the spirit and scope of the instant invention.

In one embodiment of the instant invention, the order in which themessages appear on the GUI generally corresponds to the order in whichthey were received. For example, in the illustrated embodiment of FIG.4, each message is displayed below previously received messages so thatthe order of the conversation is preserved, with older messagesappearing nearer the top of the GUI and newer messages appearing nearerthe bottom of the GUI. As the display region of the GUI fills, oldmessages are scrolled up and out of view. A user may, however, activatea scrollbar mechanism 408 using conventional point and click techniquesto alter the portion of the conversation presented in the GUI. Forexample, the user may move the scrollbar mechanism 408 upward to view anolder portion of the conversation, or downward to view a more recentportion of the conversation.

To further enhance the readability and to provide further graphicalidentification of the author of each message appearing in the GUI, eachmessage may be displayed in a speech balloon 410. The balloon 410includes a tail section 412, which generally extends toward the iconassociated with the author of the message. For example, each messagefrom the user identified by the icon Mary 400 appears in a balloon 410that has its tail section 412 extending generally toward the icon Mary400. In the event that an icon is not associated with the author of themessage, the tail section 412 is still useful to graphically illustratethe author. That is, since the GUI is divided into left and righthorizontal regions, 404, 406 a speech balloon 410 located in the lefthorizontal region 404 with its tail section 412 extending toward theleft will still provide a graphical indication of the author (e.g., Sue402 in the embodiment of FIG. 4).

The size of the balloon 410 is controlled according to the length of themessage. That is, the GUI receives a message, determines the length ofthe message, determines the size (e.g., based on the number of lines oftext to be displayed) of the balloon 410 required to display themessage, and then draws the balloon 410 with text in the appropriatehorizontal portion of the GUI using the colors, style, and iconassociated with the author of the message. A more detailed discussion ofthe sizing aspect of the speech balloons may be found below inconjunction with FIGS. 9 and 10.

During an instant messaging session it is often useful to indicate whena remote party is preparing a message to be sent. For example, afterparty A sends a message requesting a response, it is useful to know ifparty B is preparing the requested response. Knowing that the otherparty is about to respond allows a more natural flow to theconversation. For example, if party B does not answer a question fromparty A in a timely manner, party A may send a second, related request.Party B, however, may promptly respond to the first request, leavingparty A to guess at whether the response applies to the first request,the second request, or both.

Accordingly, in the embodiment of the GUI shown in FIG. 3, at block 302the software determines whether a message is being generated, and in theevent that a message is being prepared, the software at block 304delivers a signal to the other party indicating that a message is beinggenerated. One method for determining whether a message is beinggenerated is for the remote terminal to monitor an input field for anycharacters having been entered, such as via the keyboard, and reportback to the local terminal. For example, if the software detects that akeystroke has been entered or that emoticons have been selected, then itassumes that a message is being prepared to be sent to the other party,and the software sends a signal indicating that a possible responsivemessage is being prepared.

At block 306, the software checks for a signal from the other remoteparty indicating that a message is being prepared. If such a signal isreceived, control transfers to block 308 where the GUI is activated toproduce a graphical indication that a message is being prepared by theother party. An exemplary representation of the graphical indicator isshown in the exemplary GUI of FIG. 5. For example, a “thought bubble,”such as is often used in comic strips to indicate that a character isthinking, is displayed along with the icon associated with the party whois preparing the message. In the exemplary embodiment of FIG. 5, a“thought bubble” 500 provides a graphical indication that Sue 402 iscurrently preparing a message. For a number of reasons, the thoughtbubble 500 is particularly efficient for conveying the idea that theother party is preparing a response. First, the thought bubble 500appears in the GUI in the same general region that a message would bedisplayed. Second, thought bubbles are common graphical representationsfamiliar to many users. Third, because the thought bubble 500 isgraphically similar to, but easily distinguishable from, the speechballoon 410, the user may intuitively understand its function as aprecursor to an actual message. Accordingly, even inexperienced usersmay readily understand the function and operation of the instantmessaging system, and will be able to more quickly participate in aninstant messaging session at a higher level of proficiency.

In an alternative embodiment, incomplete or partial messages arecommunicated to the recipient as an indication that a message is beingprepared. In this alternative embodiment, the partial message isaccompanied by a graphic indication that the message is not yetcomplete, such as by “ . . . .” The partial messages are thenperiodically updated as more of the message is produced by the sender.

At block 310, the software checks to determine if a message has beenreceived from the other party. If so, control transfers to block 312where the software displays the text message (or emoticon, or the like)along with the icon associated with the author. In this instance, anycorresponding thought bubble is replaced by the corresponding speechballoon and its accompanying text. In the illustrated embodiments ofFIGS. 4 and 5, the messages received from the other, remote party aredisplayed on the left side 404 of a display window in the GUI.Additionally, the text message is presented in a speech balloon 410 andis left justified to further enhance its association with the other,remote party.

At block 314, the software checks to determine if the message beingprepared by the local party is complete. If so, control transfers toblock 316 and the software delivers the message over the networkconnection to the other party. The message is then displayed in thespeech balloon 410 in replacement of the thought balloon. Additionally,the software displays the text message (or emoticon, or the like) alongwith the icon associated with the author in the local GUI. In theillustrated embodiments of FIGS. 4 and 5, the messages produced by thelocal party are displayed on the right side 406 of a display window inthe GUI. Additionally, the text message is presented in a speech balloon410 and is right justified to further enhance its association with thelocal party.

Those skilled in the art will appreciate that while the instantinvention has been depicted in exemplary embodiments in which there aretwo participants to an instant messaging session, the instant inventionmay be readily employed in instant messaging sessions involving three ormore participants. In one embodiment, all locally generated messages arepresented on the right side 406 of the display window in the GUI, andall remotely generated messages are presented on the left side 404 ofthe display window. Thus, where there are two or more remoteparticipants, each of their messages are presented on the left side 404of the local participant's display window. In other embodiments, eachremote participant's messages could be displayed in a spatially distinctregion from that of the other participants. For example, messages fromfirst, second and third remote participants could be displayed in first,second and third regions, respectively, wherein the first, second andthird regions are spatially distinct. In the embodiment shown in FIG.5B, a third participant is assigned to a central region, withhis/her_icon appearing in the central region and the associated speechbubble extending generally therefrom.

Additionally, while the embodiments described herein have been shownwith the GUI divided into spatially distinct horizontal regions, it isenvisioned that other embodiments may spatially distinguish the variousparticipants in other manners without departing from the spirit andscope of the instant invention. For example, the various participantsmay be distinguished by dividing the GUI into spatially distinctvertical regions with each participant being assigned a vertical portionof the GUI. For example, the local participant may be assigned the topregion of the GUI, and the remote participant may be assigned the bottomregion. Additional remote participants may be grouped together or, asdescribed above, assigned an intermediate region, such as a verticalmiddle region. In a GUI with vertically distinct regions it may also beuseful to allow the conversation to scroll horizontally, as opposed tothe common vertical scrolling employed in many instant messagingsystems. For example, more recent messages may be displayed to the rightof older messages, with older messages scrolling off the left side ofthe GUI as the conversation advances.

If the messaging session is complete, such as by one or both of theparties logging off of the network or otherwise shutting down thesoftware, then block 318 detects the ending of the session and transferscontrol out to another program responsible for a proper and orderlywinding up of the program. Otherwise, if the instant messaging sessioncontinues, then control transfers back to block 302 where the processrepeats.

Turning now to FIG. 6, an alternative embodiment of at least a portionof the software shown in FIG. 3 is illustrated. In this embodiment ofthe software, provision is made to preserve the order of a conversationduring those instances in which a first party is preparing a responsebut the second party nevertheless sends a response before the firstparty completes and sends its response. For example, consider theinstant messaging session shown in FIG. 7 to illustrate an out-of-orderpresentation of messages in a conversation. In the embodimentillustrated in FIG. 7, Sue 402 is in the process of preparing a responseto a message 700 generated by Mary 400. Accordingly, a thought bubble702 is positioned adjacent the Sue icon 402 below the message 700. Mary400, however, did not wait for Sue's response, but sent a message 704.Thus, once Sue 402 completes and sends the response, the thought bubble702 will be replaced by a speech balloon (not shown) containing themessage. If the speech balloon (not shown) merely replaces the thoughtbubble with re-ordering, then the conversation will appear to haveoccurred in the order 700-702-704, even though the speech bubblereplacing the thought bubble 702 occurred after, not before the speechbubble 704. This out-of-sequence ordering may give rise to confusion,particularly where the participants read the flow of the conversation ata subsequent time.

The flowchart of FIG. 6 illustrates one embodiment of a method useful inreordering the speech balloons so that they appear in the GUI in theorder in which they actually occurred. Generally, the process set forthin FIG. 3 is substantially similar to that of FIG. 6, with the exceptionof blocks 600, 602, and 604. Generally, the order of the speech balloonsis maintained based upon the time that the message was completed.Thought bubbles, on the other hand, are ordered based upon the time thatthey were created and are subsequently replaced by a speech balloon.Because a thought bubble may be created well before the correspondingspeech balloon is completed, it is possible for other parties tocomplete messages in the intervening time. Thus, when the correspondingspeech bubble is completed and replaces the corresponding thoughtbubble, the order of the speech balloons may vary.

At block 306, the software checks for a signal from the other remoteparty indicating that a message is being prepared. If such a signal isreceived, control transfers to block 600 where the GUI is activated toproduce a graphical indication that a message is being prepared by theother party. The order in which the graphical indication is displayed isbased upon the time that the thought bubble was created. The time thatthe thought bubble was created may be determined from a time stampprovided by the remote user who is in the process of preparing themessage.

Thereafter, at block 310, the software checks to determine if a messagehas been received from the other party. If so, control transfers toblock 602 where the software displays the text message (or emoticon, orthe like) along with the icon associated with the author. In thisinstance, any corresponding thought bubble is removed and replaced bythe corresponding speech balloon and its accompanying text. However, thespeech balloon is ordered based upon the time completed. The time thatthe speech bubble was completed may be determined from a time stampprovided by the remote user who generated the message.

An exemplary instant messaging session that illustrates the results ofthis ordering policy is presented in FIGS. 7 and 8. In the embodimentillustrated in FIG. 7, Sue 402 is in the process of preparing a responseto a message 700 generated by Mary 400. Accordingly, a thought bubble702 is positioned adjacent the Sue icon 402 below the message 700. Mary400, however, did not wait for Sue's response, but sent a message 704.Because the speech balloons 700, 704 are ordered based on the timecompleted whereas the thought balloon 702 is ordered based on the timecreated, the order of the messages will remain as shown in FIG. 7, untilthe message from Sue 402 is finally received.

Thus, as is shown in FIG. 8, a speech balloon 800 has replaced thethought bubble 702, but is located after (or below) the speech balloon704, as the speech balloon 800 was completed after the speech balloon704. In this manner, the actual order of the conversation is preserved.

A substantially similar process occurs with respect to displaying speechballoons associated with the local user. For example, at block 314, thesoftware checks to determine if the message being prepared by the localparty is complete. If so, control transfers to block 604 and thesoftware delivers the message over the network connection to the otherparty. The message is then displayed in a speech balloon in an orderbased on the time that the message was completed.

Turning now to FIGS. 9 and 10, one exemplary method for formatting andsizing the speech balloon 410 is shown. In one embodiment, a textsystem, such as a standard text system used in Mac OS X is used toproduce the text of the message. The text system provides informationregarding the size of the text message to the GUI. The GUI uses thissize information to construct a speech balloon of an appropriate size tocontain the message. Certain rules regarding the formatting of thespeech balloon affect the size of the speech balloon. For example, inone embodiment, upper, lower, left and right margins are established. Inthe exemplary embodiment illustrated in FIG. 9A, the margins areselected as follows: upper—3; lower—5; left—13; and right—6. The text ofthe message is required to be positioned within the speech balloon andwithin these margins. Using these margins causes the speech balloon tofit tightly around the message, as illustrated in FIG. 9B, so as to beaesthetically pleasing while not unnecessarily consuming large portionsof the GUI. Reducing the size of the speech balloons allows moremessages to appear on the GUI at one time.

The GUI uses the information regarding the size of the text message andthe desired margins to produce a speech balloon of the appropriate size.The process involves dividing a template speech balloon into nineregions, such as is shown in FIG. 10A. The nine regions are comprised offour corners, left and right edges, top and bottom edges, and a centralregion. Initially, the margins are added to the rectangular area takenup by the text to produce a destination rectangle having dimensions inwhich the balloon is to be drawn. The four corner regions are drawndirectly into the corners of the destination rectangle withoutsignificant change to their shape or size. The top and bottom edges aretiled horizontally into rectangles of the appropriate width (andoriginal height). Varying the width of the top and bottom edges has thedesirable effect of altering the horizontal dimension of the speechballoon. The left and right edges are tiled vertically into rectanglesof the appropriate height (and original width) to produce a stretched ormodified speech bubble 1000, as shown in FIG. 10B. It should be notedthat the destination rectangle can be smaller than the original templateimage in either or both its vertical and horizontal dimension. Forexample, in the embodiment illustrated in FIG. 10B, the verticaldimension of the speech balloon is smaller than the vertical dimensionof the template speech balloon of FIG. 10A, and the horizontal dimensionof the speech balloon is larger than the horizontal dimension of thetemplate speech balloon of FIG. 10A.

Once the speech balloon is appropriately sized, it is color filledaccording to the requirements of the sender or the recipient, asdiscussed above. Coloration and shading of the speech balloon isaccomplished by alternative methodologies. In one embodiment, customartwork is provided for each color to produce a desired variation acrossthe surface of the speech balloon. For example, the color may be variedso that the coloration is lighter adjacent the bottom edge of the speechballoon. This coloration scheme has proven to be pleasing to users,providing the appearance of three dimensional qualities to the speechballoon. Alternatively, rather than developing custom artwork for eachpossible color, the speech balloon may be filled uniformly with thedesired color. Thereafter, standard template shadows may be overlayed toproduce a similar three dimensional effect.

Finally, while FIGS. 9 and 10 illustrate the speech balloon 410 drawnwith its tail extending leftward, so as to be used in the lefthorizontal region of the GUI, the same processes described herein may beapplied in drawing the speech balloon 410 with its tail extendingrightward, so as to be used in the right horizontal region of the GUI.In particular, when the speech balloon 410 with a rightward extendingtail is required, the speech balloon 410 with the leftward extendingtail is designed to be of the proper size for the message, and then thespeech balloon 410 is flipped horizontally or rotated about a centralvertical axis to produce the appropriately sized speech balloon 410 witha rightward extending tail. In this manner, an economy of softwarecoding is realized, as only a single routine for generating speechballoon with either leftward or rightward extending tails is required.

The particular embodiments disclosed above are illustrative only, as theinvention may be modified and practiced in different but equivalentmanners apparent to those skilled in the art having the benefit of theteachings herein. Furthermore, no limitations are intended to thedetails of construction or design herein shown, other than as describedin the claims below. It is therefore evident that the particularembodiments disclosed above may be altered or modified and all suchvariations are considered within the scope and spirit of the invention.Accordingly, the protection sought herein is as set forth in the claimsbelow.

1. (canceled)
 2. An electronic device, comprising: a display; one ormore processors; and memory storing one or more programs configured tobe executed by the one or more processors, the one or more programsincluding instructions for: displaying, on the display, a communicationsession window, the communication session window being configured todisplay a plurality of instant messages during an instant messagingsession between a local participant and a first remote participant;receiving a signal indicating that the first remote participant ispreparing an instant message; in response to receiving the signalindicating that the first remote participant is preparing an instantmessage, displaying, at a first location on the display, a graphicalindication that the first remote participant is preparing an instantmessage; receiving an instant message from the first remote participant;and in response to receiving the instant message from the first remoteparticipant: ceasing display of the graphical indication that the firstremote participant is preparing an instant message; and displaying, atthe first location on the display at which the graphical indication thatthe first remote participant is preparing an instant message waspreviously displayed, a representation of the instant message from thefirst remote participant, wherein the representation of the instantmessage is different from the graphical indication that the first remoteparticipant is preparing an instant message.
 3. The electronic device ofclaim 2, wherein: the communication session window includes a text inputfield, and the graphical indication that the first remote participant ispreparing an instant message is displayed above the text input field. 4.The electronic device of claim 2, wherein the graphical indication thatthe remote participant is preparing an instant message is displayedadjacent to a representation of the remote participant.
 5. Theelectronic device of claim 2, the one or more programs further includinginstructions for: receiving a signal indicating that a second remoteparticipant of the instant messaging session is preparing an instantmessage; and in response to receiving the signal indicating that thesecond remote participant is preparing an instant message, displaying,at a second location on the display that is different from the firstlocation, a graphical indication that the second remote participant ispreparing an instant message.
 6. The electronic device of claim 2, theone or more programs further including instructions for: whiledisplaying the graphical indication that the first remote participant ispreparing an instant message, receiving an instant message from thelocal participant; and in response to receiving the instant message fromthe local participant, displaying, on the display, a representation ofthe instant message from the local participant.
 7. The electronic deviceof claim 2, wherein: the communication session window includes arepresentation of an instant message from the local participant, and thegraphical indication that the first remote participant is preparing aninstant message is displayed below the representation of the instantmessage from the local participant.
 8. The electronic device of claim 2,wherein: the communication session window includes a representation ofan instant message from the local participant, and the representation ofthe instant message from the local participant is displayed in agraphical element that is overlaid on the background of thecommunication session window.
 9. The electronic device of claim 2,wherein the representation of the instant message from the first remoteparticipant is displayed in a graphical element that is overlaid on thebackground of the communication session window.
 10. The electronicdevice of claim 2, wherein the graphical indication that the firstremote participant is preparing an instant message is displayed in agraphical element that is overlaid on the background of thecommunication session window.
 11. The electronic device of claim 2,wherein the first location on the display is on a side of thecommunication session window that corresponds to the first remoteparticipant.
 12. A non-transitory computer-readable storage mediumstoring one or more programs configured to be executed by one or moreprocessors of an electronic device with a display, the one or moreprograms including instructions for: displaying, on the display, acommunication session window, the communication session window beingconfigured to display a plurality of instant messages during an instantmessaging session between a local participant and a first remoteparticipant; receiving a signal indicating that the first remoteparticipant is preparing an instant message; in response to receivingthe signal indicating that the first remote participant is preparing aninstant message, displaying, at a first location on the display, agraphical indication that the first remote participant is preparing aninstant message; receiving an instant message from the first remoteparticipant; and in response to receiving the instant message from thefirst remote participant: ceasing display of the graphical indicationthat the first remote participant is preparing an instant message; anddisplaying, at the first location on the display at which the graphicalindication that the first remote participant is preparing an instantmessage was previously displayed, a representation of the instantmessage from the first remote participant, wherein the representation ofthe instant message is different from the graphical indication that thefirst remote participant is preparing an instant message.
 13. Thenon-transitory computer-readable storage medium of claim 12, wherein:the communication session window includes a text input field, and thegraphical indication that the first remote participant is preparing aninstant message is displayed above the text input field.
 14. Thenon-transitory computer-readable storage medium of claim 12, wherein thegraphical indication that the remote participant is preparing an instantmessage is displayed adjacent to a representation of the remoteparticipant.
 15. The non-transitory computer-readable storage medium ofclaim 12, the one or more programs further including instructions for:receiving a signal indicating that a second remote participant of theinstant messaging session is preparing an instant message; and inresponse to receiving the signal indicating that the second remoteparticipant is preparing an instant message, displaying, at a secondlocation on the display that is different from the first location, agraphical indication that the second remote participant is preparing aninstant message.
 16. The non-transitory computer-readable storage mediumof claim 12, the one or more programs further including instructionsfor: while displaying the graphical indication that the first remoteparticipant is preparing an instant message, receiving an instantmessage from the local participant; and in response to receiving theinstant message from the local participant, displaying, on the display,a representation of the instant message from the local participant. 17.The non-transitory computer-readable storage medium of claim 12,wherein: the communication session window includes a representation ofan instant message from the local participant, and the graphicalindication that the first remote participant is preparing an instantmessage is displayed below the representation of the instant messagefrom the local participant.
 18. The non-transitory computer-readablestorage medium of claim 12, wherein: the communication session windowincludes a representation of an instant message from the localparticipant, and the representation of the instant message from thelocal participant is displayed in a graphical element that is overlaidon the background of the communication session window.
 19. Thenon-transitory computer-readable storage medium of claim 12, wherein therepresentation of the instant message from the first remote participantis displayed in a graphical element that is overlaid on the backgroundof the communication session window.
 20. The non-transitorycomputer-readable storage medium of claim 12, wherein the graphicalindication that the first remote participant is preparing an instantmessage is displayed in a graphical element that is overlaid on thebackground of the communication session window.
 21. The non-transitorycomputer-readable storage medium of claim 12, wherein the first locationon the display is on a side of the communication session window thatcorresponds to the first remote participant.
 22. A method, comprising:at an electronic device with a display: displaying, on the display, acommunication session window, the communication session window beingconfigured to display a plurality of instant messages during an instantmessaging session between a local participant and a first remoteparticipant; receiving a signal indicating that the first remoteparticipant is preparing an instant message; in response to receivingthe signal indicating that the first remote participant is preparing aninstant message, displaying, at a first location on the display, agraphical indication that the first remote participant is preparing aninstant message; receiving an instant message from the first remoteparticipant; and in response to receiving the instant message from thefirst remote participant: ceasing display of the graphical indicationthat the first remote participant is preparing an instant message; anddisplaying, at the first location on the display at which the graphicalindication that the first remote participant is preparing an instantmessage was previously displayed, a representation of the instantmessage from the first remote participant, wherein the representation ofthe instant message is different from the graphical indication that thefirst remote participant is preparing an instant message.
 23. The methodof claim 22, wherein: the communication session window includes a textinput field, and the graphical indication that the first remoteparticipant is preparing an instant message is displayed above the textinput field.
 24. The method of claim 22, wherein the graphicalindication that the remote participant is preparing an instant messageis displayed adjacent to a representation of the remote participant. 25.The method of claim 22, further comprising: receiving a signalindicating that a second remote participant of the instant messagingsession is preparing an instant message; and in response to receivingthe signal indicating that the second remote participant is preparing aninstant message, displaying, at a second location on the display that isdifferent from the first location, a graphical indication that thesecond remote participant is preparing an instant message.
 26. Themethod of claim 22, further comprising: while displaying the graphicalindication that the first remote participant is preparing an instantmessage, receiving an instant message from the local participant; and inresponse to receiving the instant message from the local participant,displaying, on the display, a representation of the instant message fromthe local participant.
 27. The method of claim 22, wherein: thecommunication session window includes a representation of an instantmessage from the local participant, and the graphical indication thatthe first remote participant is preparing an instant message isdisplayed below the representation of the instant message from the localparticipant.
 28. The method of claim 22, wherein: the communicationsession window includes a representation of an instant message from thelocal participant, and the representation of the instant message fromthe local participant is displayed in a graphical element that isoverlaid on the background of the communication session window.
 29. Themethod of claim 22, wherein the representation of the instant messagefrom the first remote participant is displayed in a graphical elementthat is overlaid on the background of the communication session window.30. The method of claim 22, wherein the graphical indication that thefirst remote participant is preparing an instant message is displayed ina graphical element that is overlaid on the background of thecommunication session window.
 31. The method of claim 22, wherein thefirst location on the display is on a side of the communication sessionwindow that corresponds to the first remote participant.